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A  TECHNIQUE  FOR  THE  SYNTHESIS  OF  LINEAR,  NONSTATIONARY 

FEEDBACK  SYSTEMS 
PART  II.  THE  SYNTHESIS  PROBLEM 


A,  R.  Stubberud 

Summary:  In  this  paper  and  a  companion  paper  a  technique  for  the  synthesis  of  linear, 
nonstationary  feedback  systems  is  presented.  This  paper  deals  with  the  synthesis 
problem,  i.e. ,  a  method  is  developed  whereby  a  given  weighting  function  can  be  synthe¬ 
sized  as  a  feedback  system.  The  problem  of  synthesizing  a  nonstationary  weighting 
function  as  a  feedback  system  when  constrained  by  a  fixed  plant  is  also  solved.  A  differ¬ 
ential  equation  algebra  which  allows  the  solution  of  these  problems  is  developed. 

INTRODUCTION 


In  a  companion  paper  18  a  technique  for  synthesizing  linear,  nonstationary  feed¬ 
back  systems  which  parallel  the  synthesis  technique  proposed  by  Guillemin,  1,  for  linear, 
stationary  feedback  systems  was  proposed.  In  the  companion  paper  the  approximation 
problem  was  discussed.  In  this  paper  the  synthesis  problem  will  be  discussed.  An 
algebra  of  linear  differential  equations  is  first  developed,  and  this  algebra  is  then  used 
to  show  that  a  given  weighting  function  can  always  be  synthesized  as  a  feedback  system. 

AN  OPERATOR  ALGEBRA  FOR  DIFFERENTIAL  EQUATIONS 


Once  the  weighting  function  of  a  system  has  been  determined  by  either  the  tech¬ 
nique  described  in  a  companion  paper  18  or  by  one  of  the  other  known  techniques,  the  next 
step  in  the  development  is  to  realize  this  system  in  the  form  of  a  feedback  system.  First, 
however,  the  differential  equation  of  which  the  weighting  function  is  a  solution  must  be 
determined.  A  technique  for  generating  a  differential  equation  from  its  weighting  function 
has  been  discussed  2,  4,  elsewhere;  therefore  only  the  necessary  steps  are  repeated  here. 


If  a  weighting  function  has  the  form 
n 

W(t,r)=>  0.  (t)  q.  (t)  +  b  (t)  fi(t-T)  t>r 

Lj  i  l  n 

i=  1 

=  0  t  <  r 


(1) 


where  the  /L(t)  and  q^(t)  have  a  sufficient  number  of  derivatives,  then  W(t,r)  satisfies 

the  differential  equation 

n  n 


I  ai<*> 
1  - 


at 


6(t-T) 


- 


(2) 


where  an(t)  =  1  and  the  a^(t)  and  b^(t)  are  continuous  functions  of  time.  The  a^(t)  and  b.(t) 

of  the  differential  equation  can  then  be  determined  from  the  known  W(t,T)  as  follows.  The 
taine 

n-1 


a^(t)  are  obtained  immediately  as  solutions  of  the  n  simultaneous  equations. 


I 


a.(t) 


1=0 


d  q^(t) 
dt1 


dnq,(t) 

_ J 


dt 


n 


j  =  1,2,  ...  ,n 


(3) 


This  set  of  equations  always  has  a  unique  solution  since  the  determinant  of  the  equations 

is  the  Wronskian  of  the  q . (t )  which  are  linearly  independent  functions.  After  the  a.(t) 

J  i 

have  been  determined,  the  bj(t)  are  determined  from  the  equations 


i-k 


b  ,<t).y  y  (n+s:‘)a  . 

n-i  Lj  L-i  \  n-i  /  n-i 


k=o  s=o 


i+k+s 


(t) 


dSFk(t) 

dtS 


(4) 


i  =  1,2,...  ,n 


where 


(  i^)  binomial  coefficient  and  the  F^t)  are  given  by  the  relationships: 


Fo(‘)  =  bn(t) 


Fk(t) 


=  {^l[W(t'T)]} 


k  =  1,  2,  .  .  . , n 


(5) 


T=t 


Thus  application  of  Equations  (3),  (4),  and  (5)  allow  generation  of  a  differential  equation 
from  its  corresponding  weighting  function.  This  step  is  necessary  since  from  this  point 
on  all  manipulations  are  done  on  the  differential  equations  which  correspond  to  the 
elements  in  the  system.  (It  should  be  kept  in  mind  that  whenever  possible  it  is  desirable 
to  work  with  the  corresponding  weighting  functions;  these  are  in  general  unknown,  hence 
the  more  general  differential  equation  approach  is  used. ) 


To  aid  in  the  development  in  the  next  section  it  is  desirable  to  develop  an  operator 
algebra  which  will  simplify  many  of  the  manipulations  which  are  found  necessary.  Since 
a  linear  differential  equation  of  the  form 
n  n 


I  ai<i) 


I  V‘> 

1  r 


(6) 


is  a  linear  transformation  of  x  into  y,  the  algebra  is  an  algebra  of  linear  transformations. 
The  transformations  (linear  differential  equations)  which  are  considered  will  all  have  the 
form  of  Equation  (6)  where  some  of  the  a^(t)  and  b^(t)  may  be  zero.  In  the  following 

development,  capital  letters  (A,  B,  C.  .  . )  are  used  to  denote  differential  equations  and 
represent  equations  of  the  form  of  Equation  (6).  In  addition,  all  initial  conditions  are 
assumed  to  be  zero. 
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The  algebra  of  differential  equations  involves  three  operations: 

(1)  Addition  of  two  differential  equations,  i.e. , 

A  +  B  =  C  (7) 

(2)  Multiplication  of  differential  equation  by  a  scalar,  i.e., 

p(t)  A  =  B  (8) 

or  A  p(t)  =  C  (9) 

(Clearly  if  p(t)  is  a  constant,  B  =  C. ) 

(3)  Multiplication  of  two  differential  equations,  i.e. , 

A  B  =  C  (10) 


These  operations  are  indicated  in  block  diagram  form  in  Figure  1.  Obviously,  in 
order  for  this  algebra  to  be  useful,  each  of  these  operations  must  be  defined.  In  addition 
the  following  useful  properties  of  this  algebra  will  be  defined; 

(1)  A  unity  element 

(2)  A  zero  element 

(3)  An  additive  inverse 

(4)  A  multiplicative  inverse 

Multiplication  of  Two  Differential  Equations.  It  is  necessary  to  define  multiplication 
first  since  it  is  used  in  defining  addition.  It  is  obvious  from  Figure  1(d)  that  multipli¬ 
cation  is  identical  to  convolution  if  A  and  B  represent  weighting  functions. 


Any  differential  equation  of  the  form  in  Equation  (6)  can  be  divided  into  two  parts: 
a  differential  operator  and  an  integral  operator  as  indicated  in  Figure  2.  The  relation¬ 
ships  between  the  variables  x,  y  and  z  are,  in  terms  of  the  notation  of  Equation  (6): 


z 


n 


I  V> 


n 


(ID 


(12) 


Now  if  two  differential  equations  are  multiplied  together,  this  operation  can  be  repre¬ 
sented  by  Figure  3(a).  The  equations  which  define  the  relationships  between  the  variables 
in  this  system  are: 


n 


1 V*1 


djx 


dtJ 


(13) 
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(0)  ADDITION  OF  TWO  DIFFERENTIAL  EQUATIONS 


(b)  PRE- MULTI  PLICATION  OF  A  DIFFERENTIAL  EQUATION 
BY  A  SCALAR 


(C)  POST -MULTIPLICATION  OF  A  DIFFERENTIAL  EQUATION 
BY  A  SCALAR 


(d)  MULTIPLICATION  OF  TWO  DIFFERENTIAL  EQUATIONS 

OPERATIONS  OF  TRANSFORMATION  ALGEBRA 
FIGURE  1 


4 


(14) 


m 


2  V‘> 

d  m 


dSy  _ 


dt 


k=o 


In  Figure  3(b)  the  two  inner  operators  in  Figure  3(a)  have  been  "interchanged".  In 
general  these  operators  are  not  commutable,  therefore 

Diff2  4  Diff3 
Int^  4  Intg 


It  is  necessary  at  this  point  to  determine  the  relationships  between  x^,  W  and  y^  in  terms 

of  the  parameters  of  Equations  (13)  and  (14).  Assume  that  these  relationships  can  be 
written 


m 


drx 


1  8r(,)  TF 
r=o  dt 


1 


=  W 


(15) 


and 


n 


,s 

d  y1 


>  h  (t)  — r 
Lt  s  ,.s 
s=o  dt 


=  W 


(16) 


where  g  (t)  and  h  (t)  are  as  yet  unknown  coefficients.  Substituting  the  values  for  x  and 
I*  S  1  _ 

y^,  each  in  terms  of  y,  into  Equations  (15)  and  (16)  produces  the  relationship: 


m  n 


X  X  X  (,*)..« 


d(<"-C)a.(t) 


a-o  i=o  c=o 
n  m 


dt 


(a- c) 


I  I  1(f)  V‘> 

/3=o  l=o  6=o 


dt 


03-6) 


d,i+0V . 


dt 


(i+c) 


d(/3"6)fl(t)  d(1+6\ 


(1+6) 


(17) 


dt 


If  the  coefficients  of  like  derivatives  of  y  are  equated,  a  system  of  m+n+1  simultaneous 
equations  in  the  m+n+2  unknown  g^(t)  and  h^(t)  are  formed.  Arbitrarily  choosing  h^t)  =  1 

(without  loss  of  generality)  allows  these  equations  to  be  solved  for  the  remaining  m+n+1 
unknowns.  This  operation  shows  the  equivalence  of  Figures  3(a)  and  3(b).  Figure  3(b) 
can  be  further  reduced  to  Figure  3(c)  by  combining  the  differential  and  integral  operators 
and  the  resulting  equation  is: 


n  m  j3 
\  \  \ 
l.  L  L 

p=o  k=o  f=o 


H(k+f) 

d  z 


dt 


0-f) 


dt 


(k+f) 
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(0)  PRODUCT  OF  TWO  DIFFERERENTIAL  EQUATIONS 


<18) 


m  n  a 

■nio 


d(a"r)b.(t)  d(j+r)x 


a=o  2=0  r=o 


dt 


( a-r ) 


dt 


(j+r) 


where  x  is  the  system  input  and  z  the  output.  Multiplication  of  two  differential  equations 
defined  by  Equations  (13)  and  (14)  is  then  defined  by  the  steps  indicated  in  Equations  (15), 
(16),  (17),  and  (18)  and  is  denoted  symbolically  by 


A  B  =  C 


(19) 


where  A  corresponds  to  (13),  B  to  (14),  and  C  to  (18). 


The  TTnity  Element.  The  unity  element  is  defined  as  that  element  which  when  applied  to  a 
function  leaves  the  function  unchanged.  In  differential  equation  algebra,  the  unity 
element  is  any  differential  equation  of  the  form 


n 


1  ai(i> 


i=o 


(20) 


where  x  is  the  input  and  y  is  the  output.  Since  the  initial  conditions  are  assumed  zero, 
y=x  and  this  equation  indeed  represents  a  unity  element  which  will  be  denoted  I. 


The  Multiplicative  Inverse.  A  multiplicative  inverse  is  defined  as  a  differential  equation 

(which  will  be  denoted  A  *)  which  has  the  property  that  if  it  is  multiplied  by  the  differential 
equation  A,  a  unity  element  is  produced.  Symbolically  this  is  denoted 


A_1A  =  AA"1  =  I 


(21) 


It  was  shown  in  Reference  8  that  if  A  is  represented  by  the  differential  equation 
n  .  n 


y  a.<t)  si  =  y  mu  si 

A  1  at1  ■  1  dtJ 

1=0  at  j=o  UL 


(22) 


-1  . 


where  x  is  the  input  and  y  is  the  output,  then  A  is  represented  by  the  differential  equation 


n  n 

y  b.,t)  si .  y  a.<t)  si 

L  1  L 1  d.1 


(23) 


j=o  '*•  i=o 

where  x  is  the  output  and  y  is  the  input. 


Addition  of  Two  Differential  Equations.  Addition  of  two  differential  equations  is  repre¬ 
sented  symbolically  in  Figure  4(a).  As  in  the  case  of  multiplication,  the  differential 
equations  have  been  divided  into  differential  and  integral  operators.  The  addition  is  per¬ 
formed  step-by-step  as  indicated  by  the  block  diagrams  in  steps  indicated  in  Figure  4.  In 
step  1  the  original  system  is  multiplied  by  the  cascade  combination  of  two  differential 
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4  (b)  STEP  I 


4  (C)  STEP  2 


4(d)  STEP  3 


4(6)  STEP  4 


4(f)  STEP  5 


4(g)  STEP  6 


ADDITION  OF  DIFFERENTIAL  EQUATIONS 
FIGURE  4 
8 


operators  denoted  (Intj)’1  and  [(Int2)'J  1  and  two  integral  operators  Int1  and  (Int2)' 

which  are  their  respective  multiplicative  inverses.  This  combination  then  represents  a 

unity  element.  Since  the  system  is  linear  (Int^  1  can  be  moved  to  the  left  of  the  summing 

junction,  thus  eliminating  Int  from  the  upper  element  as  shown  in  Figure  4(c).  Now  the 

1  -1 

integral  operator  Int2  and  the  differential  operator  (Int^)  are  multiplied  and  the  product 

seoarated  into  its  new  differential  and  integral  operators  as  indicated  in  step  3,  where 

t-1  |  i 

(Int^)  and  the  new  integral  operator  is  de- 

is  now  moved  to  the  left  of  the  summing  junction  thus  cancelling 

To  the  left  of  the  summing  junction  there  are  now  only  differential  operators 

and  to  the  right  only  integral  operators.  These  can  then  be  combined  as  indicated  in 
steps  5  and  6,  and  thus  addition  of  differential  equations  has  been  defined. 


the  new  differential  operator  is  denoted 
noted  (Intg)'.  (Intg 1 ) 

(Int2)' 


The  Zero  Element.  The  zero  element  in  differential  equation  algebra  is  defined  as  any 
differential  equation  whose  output  is  always  identically  zero.  The  zero  element  is 
denoted  0. 


The  Additive  Inverse.  The  additive  inverse  of  a  differential  equation  A  is  defined  as  that 
differential  equation  B  which  when  added  to  A  produces  a  zero  element,  i.e. , 

A  +  B  =  0  (24) 

It  is  quite  obvious  that  if  A  is  the  differential  equation 


where  x  is  the  input  and  y 


Multiplication  of  a  Differential  Equation  by  a  Scalar.  Multiplication  of  a  differential 
equation  by  a  scalar  can  be  considered  to  be  a  degenerate  case  of  multiplication  of  two 
differential  equations  where  one  of  the  differential  equations  is  the  degenerate  equation 

y  =  p(t)x  (27) 

in  which  x  is  the  input  and  y  is  the  output.  The  techniques  developed  for  multiplying 
differential  equations  are  then  applicable  to  multiplication  of  a  differential  equation  by  a 
scalar. 


n 


I 


1  =  0 


a^t) 


dx 

dt1 


is  the  output,  then  B  has  the  form 
n 


-I 

j=o 


b.(t) 

J 


d^x 


dt 


J 


(26) 


n 


1  =  0 


ai(t,  SX 
dt 


n 

I 

j=o 


b,(t) 


d^x 

d?" 


(25) 


In  addition  to  the  above  mentioned  properties  of  differential  equation  algebra,  the 
following  laws  hold: 
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(1)  Addition  is  commutative,  i. e.,  A+B  =  B+A 

(2)  Addition  is  associative,  i.e.,  A+(B+C)  =  (A+B)+C 

(3)  Multiplication  is  not  commutative,  i.e.,  A  B  ^  B  A 
(In  the  stationary  case  multiplication  is  commutative. ) 

(4)  Multiplication  is  associative,  i.e.,  A  (B  C)  =  (A  B)  C 

(5)  Distributivity  is  valid,  i.e. ,  A  (B+C)  =  A  B  +  A  C 


In  this  section  an  algebra  for  differential  equations  has  been  discussed.  With  the  aid 
of  this  algebra  it  is  shown  in  the  next  section  how  linear  system  synthesis  can  be  carried 
out  operating  only  on  differential  equations. 

SYNTHESIS  OF  A  DIFFERENTIAL  EQUATION  AS  A  FEEDBACK  SYSTEM 

Once  the  differential  equation  algebra  of  the  preceding  section  has  been  developed,  its 
application  to  the  synthesis  problem  is  as  straightforward  conceptually  as  is  the  appli¬ 
cation  of  Laplace  transform  algebra  in  the  synthesis  of  linear  stationary  systems.  The 
advantage  of  such  an  algebra  is  that  all  of  the  manipulative  operations  can  be  performed 
symbolically  and  the  numerical  details  carried  through  only  at  the  end  of  the  process. 

To  describe  the  technique  of  synthesis,  the  feedback  configuration  in  Figure  5  will  be 
examined.  In  this  figure  r  is  the  input,  c  is  the  output,  and  K,  G,  and  H  are  differential 
equations,  m  and  e  are  intermediate  variables  in  the  system.  In  the  following  the 


GENERAL  FEEDBACK  CONFIGURATION 
FIGURE  5 

operation  (x)  represents  the  operation  which  a  differential  equation  performs  on  a  variable 
to  produce  a  new  variable.  Let  the  relationship  between  the  input  r(t)  and  the  output  c(t) 
be 


c  =  Wxr 


(28) 


where  W  is  the  desired  overall  differential  equation.  From  the  figure  it  is  seen  that 


y  =  Hxc  (29) 

and  e  =  r-y  =  r  -  Hxc  (30) 

Since  C  =  GKxe  (31) 

then  r  =  Ixc  +  HGKxc  =  [i  +  HGK]  xe  (32) 

by  virtue  of  the  fact  that 

Ixe  =  e  (33) 
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Applying  the  multiplicative  inverse  of  (I  +  HGK)  to  both  sides  of  (32)  the  equation 


€  =  [i  +  HGk]  -1  xr  (34) 

results.  Then  since 

c  =  GK  x  e  (35) 

substitution  of  (34)  into  (35)  produces  the  equation 

c  =  GK  [i  +  HGK]  _1xr  .  (36) 

Comparison  of  Equations  (28)  and  (36)  reveals  that 

W=  GK  [i  +  HGK]  _1  (37) 


Equation  (37)  may  be  considered  the  fundamental  relationship  for  Figure  5.  Two  special 
cases  of  the  configuration  in  Figure  5  will  now  be  considered. 

Synthesis  of  a  Feedback  System  Unconstrained  by  a  Fixed  Plant.  Suppose  that  a  given 
overall  differential  equation  W  is  to  be  realized  as  a  feedback  system  with  a  unity  feed¬ 
back,  i.  e. ,  it  is  to  have  the  configuration  in  Figure  6.  The  problem  then  is  to  determine 


UNITY  GAIN  FEEDBACK  SYSTEM 
FIGURE  6 


G  in  terms  of  W.  Since  in  this  case 

K  =  H  =  I  (38) 

Equation  (37)  reduces  to 

W  =  G(I+G)_1  (39) 

Solving  Equation  (39)  for  G  the  relationship 

G  =  W(I  -  W)”1  (40) 

is  obtained.  Therefore  a  given  differential  equation  W  can  be  synthesized  as  a  unity  feed¬ 
back  system  with  G  as  the  feedforward  element  through  Equation  (40).  The  actual  differ¬ 
ential  equation  of  G  is  obtained  by  performing  the  operations  indicated  in  Equation  (40). 

Synthesis  of  a  System  Constrained  by  a  Fixed  Plant.  In  this  case  let  W  be  the  differential 
equation  of  the  overall  system  of  the  configuration  in  Figure  7.  G  is  the  differential 
equation  of  the  known  fixed  plant.  The  problem  is  to  find  the  differential  equation  of  a 
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FEEDBACK  SYSTEM  WITH  FIXED  PLANT 
FIGURE  7 

suitable  compensation  network  K  such  that  this  system  has  the  desired  overall  response 
indicated  by  W.  Setting  H  =  I  in  Equation  (37)  and  solving  for  K,  the  relationship 


K  =  G'1  [i  -  w]  _1 


is  formed.  Performing  the  operations  indicated  symbolically  in  Equation  (41),  the  differ¬ 
ential  equation  for  K  is  obtained. 

Example:  As  an  example  of  the  process  described  above  consider  the  following  problem. 
Suppose  that  G  in  Figure  7  is  a  fixed  plant  described  by  the  differential  equation 

+  +  6  tc  =  <42) 
dt 

and  it  is  desired  to  choose  K  such  that  the  overall  differential  equation  W  has  the  form 


lf+2£Uc  =  r(t)  (4= 

dt 

which  is  obviously  stationary.  Because  of  the  stationarity  of  W  the  differential  equation 
I-W  is  easily  obtained  by  the  method  of  addition  of  differential  equations  as: 

dt  dt 

where  z  is  the  input  and  c  is  the  output.  The  differential  equation  (I-W)  can  then  be 
formed  and  is  given  by: 


rr+2f  =  *(,) 

dt 

The  differential  equation  for  K  is  finally  determined  by  forming  the  product 


K  =  G-1  (I-W)_1W 
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and  the  equation  for  this  compensation  network  is  found  to  be: 


d2c  ,  2+3e  *  de  ,  ,,  ,  -tv  d2m  .  3+4e  t  dm  ,  2+3e  t 

T?  +  7^r  *  +  u+e  )£=Tr  +  — dT+— —  m 

dt  1+e  dt  1+e  1+e 


(47) 


Thus  the  compensating  network  is  completely  specified  by  Equation  (47).  This  network  can 
be  synthesized  by  analog  computer  elements  in  a  relatively  straightforward  manner  by  the 
techniques  in  Reference  15. 


CONCLUSIONS 


In  this  paper  and  a  companion  paper  18  a  technique  for  synthesizing  linear  nonstation¬ 
ary  feedback  systems  has  been  developed.  For  the  synthesis  of  systems  which  receive  in¬ 
puts  which  are  polynomials  in  time,  the  technique  is  complete,  i.e.,  it  includes  both  the 
approximation  problem  and  the  synthesis  problem.  In  any  event  once  the  overall  system 
weighting  function  or  overall  system  differential  equation  has  been  specified,  the  synthesis 
technique  leads  to  an  exact  synthesis  of  the  system. 

Also  included  in  this  paper  is  a  discussion  of  an  algebra  of  differential  equations  which 
is  valuable  to  problems  in  both  analysis  and  synthesis.  This  algebra  allows  manipulation 
of  linear,  nonstationary  systems  in  a  more  logical  manner  than  has  been  possible  heretofore 

The  synthesis  technique  has  been  applied  to  a  simple  single  loop  system  in  this  re¬ 
port.  There  is  no  reason,  however,  for  its  not  being  applied  to  both  multiple -loop  and 
multiple -variable  systems  with  equal  facility. 

In  conclusion,  as  a  result  of  a  review  of  the  literature,  it  appears  that  this  is  the 
first  general  and  complete  synthesis  technique  which  is  applicable  to  a  wide  class  of 
linear,  nonstationary  feedback  systems. 
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